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Japanese Unexamined Patent Application Publication No. 63-199589 

1 TITLE OF THE INVENTION 

Inter-frame coding method 

2 CLAIMS 

(1) . An inter-frame coding method for performing inter-frame 
coding or inter-frame decoding in which a filter (1) is provided 
before a predictor (2) having a frame memory in a decoding loop, 

wherein a selector (3) is provided which selects and outputs 
an input-side signal or an output-side signal of the filter (1) using a 
control signal, and 

said method comprising 

controlling said selector (3) adaptively so as to cause said 
selector to output a reproduction signal. 

(2) . The inter-frame coding method according to Claim 1, 

wherein said selector (3) is controlled according to motion 
vector information. 

(3) . The inter-frame coding method according to Claim 1, 

wherein said selector (3) is controlled by difference 
information between an input signal and the input-side signal of the 
filter (1), and between the input signal and the output-side signal of 
the filter (1). 

SPECIFICATION 

3 Detailed description of the invention 



[Summary] 
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In a method in which a filter is provided before a predictor in 
a decoding loop and in which inter-frame coding or inter-frame 
decoding is performed, signals before or after filtering are 
adaptively selected using motion vector information and the like so 
as to be used as a reproduction signal. For example, in the case 
where a resolution of a reproduction display decreases due to the 
filtering, a signal before the filtering is selected and outputted. 

[Industrial Applicability] 

The present invention relates to an inter-frame coding 
method in which a filter is provided before a predictor and in which 
inter-frame coding or inter-frame decoding is performed. 

In an inter-frame coding method in which coding efficiency is 
improved and impulse noise caused by a prediction is reduced by 
providing a filter in the loop, there are cases where a decrease in 
resolution of a reproduction display is noticeable depending on a 
kind of an image. Therefore, it is desired to prevent such a 
decrease in the resolution. 

[Description of the Related Art] 

In an inter-frame coding method for performing inter-frame 
coding or inter-frame decoding, a method is employed in which 
impulse noise is reduced by providing a filter provided in a loop and 
coding efficiency is improved. FIG. 6 is a block diagram showing 
transmitting-side main components in a conventional art. In FIG. 6, 
a reference numeral 51 denotes a filter, 52 denotes a predictor 
including a frame memory, 53 denotes a subtractor, 54 denotes an 
adder, 55 denotes an inverse quantizer, 56 denotes a quantizer, and 
57 denotes a coder. The filter 51 is provided before the predictor 
52. 

In the configuration as above, when an input signal is 
provided to the subtractor 53 from a television camera and the like, 
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an inter-frame differential signal is determined which is a difference 
between the input signal and a prediction signal from the predictor 
52, the differential signal is quantized by the quantizer 56, the 
quantized output signal is coded by the coder 57, and the coded 
signal is outputted to the receiving side. At the same time, the 
quantized output signal is inverse-quantized by the inverse 
quantizer 55 and thus the inter-frame differential signal is 
reproduced. The differential signal is added to the prediction signal 
in the adder 54 to be a local decoded signal. The local decoded 
signal is provided to the filter 51 and filtered. Subsequently, the 
local decoded signal is provided to the predictor 52, and at the same 
time, serves as a reproduction signal which is to be provided to a 
monitor and the like. 

Furthermore, in transmitting a video, a block-matching-type 
motion compensation inter-frame coding method is employed 
because the inter-frame differential signal is large. In this method, 
inter-frame prediction is performed by determining a motion vector 
of a block having a predetermined size, and shifting the position of 
a prediction value according to the motion vector, and thus 
prediction efficiency does not decrease even in the case of an image 
having large motion. Moreover, the motion vector information is 
transmitted to the receiving side together with the coded signal of 
the differential signal. 

In the receiving side, the inter-frame differential signal can 
be obtained by decoding and inverse quantizing the received coded 
signal, the obtained inter-frame differential signal is added to a 
signal from the frame memory, the resulting output is filtered by the 
filter, and the filtered output is provided to the frame memory. The 
configuration of the inverse quantizer 55, the adder 54, the filter 51, 
and the predictor 52 in the receiving side is the same as those in the 
transmitting side. A filtered signal is used as the reproduction 
signal. In addition, a variable delay unit for motion compensation 
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is added to the configuration of the receiving side in which the 
block-matching-type motion compensation inter-frame coding 
method is used. 

[Problems that Invention is to Solve] 

As described above, in the inter-frame coding method in 
which the filter 51 is provided in the local decoding loop, the output 
signal from the filter 51 is used as the reproduction signal, and the 
filter 51 removes impulse noise. However, this method has the 
following drawback. In the case of a still image or an image having 
small motion which is almost a still image, the filtering by the filter 
51 suppresses a high frequency component, resulting in a decrease 
in the resolution. 

An object of the present invention is to perform filtering 
without a decrease in visual resolution. 

[Means to Solve the Problems] 

Referring to FIG. 1, in the inter-frame coding method 
according to the present invention, the filter 1 is provided before the 
predictor 2 in the decoding loop in which a signal from a coding or 
decoding unit 5 and the prediction value are provided to the adder 4 
and decoded, the selector 3 which selects between the input side 
and output side of the filter 1 according to a control signal, and the 
selector 3 is adaptively controlled to select between the input-side 
signal and the output-side signal, either of which serves as the 
reproduction signal. 

[Technical Functions] 

In the case of an image having large motion, the details of the 
received reproduction image cannot be perceived visually. 
Therefore, the signal filtered by the filter 1 is selected by the 
selector 3 and used as a reproduction signal, and in the case of an 
image having small motion, it is desirable that the details of the 
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received reproduction image can be perceived visually. Therefore, 
a signal which is not filtered by the filter 1 is selected by the selector 
3 and used as a reproduction signal. With this, coding efficiency 
can be improved by the filtering without a decrease in the visual 
resolution. 

[Embodiments] 

The following describes the details of embodiments of the 
present invention with reference to the drawings. 

FIG. 2 is a block diagram showing the transmitting-side main 
components according to an embodiment of the present invention. 
FIG. 3 is a block diagram showing the receiving-side main 
components in the case where block-matching-type motion 
compensation inter-frame coding method is applied. In each figure, 
a reference numeral 10 denotes a subtractor, 11 and 21 denote 
filters, 12 and 22 denote frame memories, 13 and 23 denote 
selectors, 14 and 24 denote adders, 15 and 25 denote inverse 
quantizers, 16 denotes a quantizer, 18 and 28 denote determiners, 
19 and 27 denote variable delay units, 20 denotes a motion 
compensation unit, 17 denotes a coder, and 26 denotes a decoder. 

The filters 11 and 21 are provided before the frame memories 
12 and 22 in the predictor. The selectors 13 and 23 which select 
between the input-side signals and the output-side signals of the 
filters 11 and 21 are controlled by control signals from the 
determiners 18 and 28, and the selected signals are used as 
reproduction signals. 

In the transmitting side, an input signal from a TV camera and 
the like is provided to the subtractor 10 and the motion 
compensation unit 20. The motion compensation unit 20 matches 
the input signal against a signal from the frame memory 12, for 
example, based on an 8 x 8 block, and determines a motion vector 
of the 8 x 8 block. The variable delay unit 19 is controlled to 
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correct the signal from the frame memory 12 according to the 
motion vector, and the corrected signal is used as a prediction value 
which is to be provided to the subtractor 10 and the adder 14. 
Moreover, motion compensation information is provided from the 
motion compensation unit 20 to the determiner 18 which determines 
whether or not the motion is large. Furthermore, the motion vector 
information is provided, to the coder 17 via a path which is not 
illustrated, and transmitted to the receiving side. 

The subtractor 10 outputs an inter-frame differential signal 
between the input signal and the motion-compensated prediction 
signal. The quantizer 16 quantizes the inter-frame differential 
signal. The quantized output signal is encoded by the coder 17 and 
used as an output signal to the receiving side. At the same time, 
the quantized output signal is inverse-quantized by the inverse 
quantizer 15 and used as an inter-frame differential signal. The 
adder 14 adds the inter-frame differential signal and the prediction 
signal to obtain a local decoded signal. 

The local decoded signal is inputted to the filter 11 and, for 
example, spatial filtering is performed in which the weight for a 
target pixel is four, the weight for four pixels which are adjacent to 
the target pixel is one, and the arithmetic mean value of the 
luminance of the five pixels is used as luminance of the target pixel. 
The filtered output signal is provided to the frame memory 12 and 
held for a period of one frame. 

The local decoded signal at the input-side of the filter 11 and 
the filtered output signal from the filter 11 are provided to the 
selector 13, and motion vector information provided from the 
motion compensation unit 20 is provided to the determiner 18 in 
order to determine whether or not the provided signal has large 
motion for the block. When the provided signal has large motion, 
the output signal of the filter 11 is selected as the reproduction 
signal. When the motion is small, the input-side signal of the filter 
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11 is selected as the reproduction signal. 

On the other hand, in the receiving side, the received signal is 
provided to the decoder 26 and decoded, inverse-quantized by the 
inverse quantizer 25 to be an inter-frame differential signal, and 
provided to the adder 24. Furthermore, the motion vector 
information from the transmitting side is demultiplexed in the 
decoder 26, and provided to the variable delay unit 27 and the 
determiner 28. The variable delay unit 27 delays, according to the 
motion vector information, one block of signals read from the frame 
memory 22 and outputs a motion-compensated prediction signal. 
The prediction signal and the inter-frame differential signal from the 
inverse quantizer 25 are added by the adder 24, and the resulting 
output signal serves as a decoded signal. The decoded signal is 
filtered by the filter 21, provided to the frame memory 22, and held 
therein for the period of one frame. 

The determiner 28 determines whether the image has large 
motion or small motion based on the motion vector information, and 
provides the control signal to the selector 23. The control signal 
controls the selector 23 for the block so that the output signal of the 
filter 21 is selected and outputted as a reproduction signal in the 
case of the image having large motion, and the input-side signal of 
the filter 21 is selected and outputted as a reproduction signal in the 
case of the image having small motion. 

Accordingly, in the transmitting side and the receiving side, 
the input-side signals or the output-side signals of the filters 11 and 
21 are adaptively selected to be the reproduction signals based on 
the motion vector information. In this regard, since the difference 
in the image having large motion cannot be perceived visually, the 
filtered signal is used as the reproduction signal, and since the 
details of the image having small motion can visually be perceived, 
the signal before the filtering is used as the reproduction signal. As 
a result, the coding efficiency can be improved by the filtering 
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without a decrease in the visual resolution. 

Furthermore, in the present embodiment, motion vector 
information in the block-matching-type motion compensation 
inter-frame coding method is utilized, and the motion vector 
information is transmitted along with the inter-frame coding signal 
from the transmitting side to the receiving side. Therefore, a 
particular signal for controlling the selector 23 need not be 
transmitted. 

FIG. 4 is a block diagram showing transmitting-side main 
components, and FIG. 5 is a block diagram showing receiving-side 
main components, both of which are according to another 
embodiment of the present invention. A reference numeral 30 
denotes a subtractor, 31 and 41 denote filters, 32 and 42 denote 
frame memories, 33 and 43 denote selectors, 34 and 44 denote 
adders, 35 and 45 denote inverse quantizers, 36 denotes a quantizer, 
37 denotes a coder, 38 denotes a determiner, 39 and 40 denote 
subtracters, 46 denotes a decoder, and 47 denotes a determination 
controller. 

The present embodiment applies to the case where no motion 
compensation is performed, and the operations for inter-frame 
coding and decoding are the same as those in the above described 
embodiment. In the present embodiment, the difference between 
an input-side signal of the filter 31 and an input signal, and the 
difference between an output-side signal of the filter 31 and the 
input signal are determined in the subtracters 39 and 40. 
Subsequently, output signals dl and d2 from the subtracters 39 and 
40 are provided to the determiner 38, and the determiner 38 
provides a control signal to the selector 33 so that the input-side 
signal of the filter 31 is selected when dl < d2, and the output-side 

signal of the filter 31 is selected when dl ^ d2. 

In other words, the signal which has a smaller difference with 
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respect to the input signal is selected. When the motion is small, 
the difference signal d2 between the input signal and the output 
signal of the filter 31 is larger than the difference signal dl between 
the input signal and the local decoded signal because the 
high-frequency component is suppressed by the filter 31. Thus, in 
this case, the input-side signal of the filter 31 is selected and 
outputted as a reproduction signal. On the other hand, when the 
motion is large, the difference signal dl between the input signal 
and the local decoded signal is larger than the difference signal d2 
between the input signal and the output signal of the filter 31. Thus, 
the output signal of the filter 31 is selected and outputted as a 
reproduction signal. 

The control signal provided to the selector 33 is transmitted 
to the receiving side via the coder 37 in a manner similar to the 
above motion vector information. 

In the receiving side, the decoder 46 decodes the received 
signal, the inverse quantizer 45 quantizes the decoded signal, and 
the adder 44 adds the quantized signal and a prediction value from 
the frame memory 42 for decoding. Furthermore, the control 
signal from the transmitting side is demultiplexed in the decoder 46 
and provided to the determination control unit 47, and then an 
input-side signal or the output-side signal of the filter 41 is selected 
by the selector 43 through control by the determination control unit 
47 and outputted as the reproduction signal. 

[Advantageous Effects of the Invention] 

As described above, according to the present invention, the 
filter 1 is provided before the predictor 2 in the decoding loop, the 
selector 3 is provided which selects the input-side signal or the 
output-side signal of the filter 1, and the selector 3 is adaptively 
controlled so as to output the reproduction signal. With this, the 
following advantages can be obtained: the filter 1 improves the 
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coding efficiency; and the visual resolution of the reproduced image 
is not reduced by adaptively selecting, as the reproduction signal, a 
signal before or after the filtering. Furthermore, the adaptive 
control of the selector 3 can easily be performed using the motion 
vector information, the differential signals between the input signal 
and the signal before the filtering and between the input signal and 
the signal after the filtering, and others. 

4 Brief description of the Drawings 

FIG. 1 is a diagram showing a principle of the present 
invention, FIG. 2 is a block diagram showing the transmitting-side 
main components according to an embodiment of the present 
invention, FIG. 3 shows a block diagram showing the receiving-side 
main components according to an embodiment of the present 
invention, FIG. 4 is a block diagram showing transmitting-side main 
components according to another embodiment of the present 
invention, FIG. 5 is a block diagram showing receiving-side main 
components according to another embodiment of the present 
invention, and FIG. 6 is a block diagram showing main components 
in the conventional art. 

Reference numerals 1, 11, 21, 31, and 41 denote filters, 2 
denotes a predictor, 12, 22, 32, and 42 denote frame memories, 3, 
13, 23, 33, and 43 denote selectors, 4, 14, 24, and 34, 44 denote 
adders, 5 denotes a coding or decoding unit, 15, 25, 35, and 45 
denote inverse quantizers, 16 and 36 denote quantizers, and 17 and 
37 denote coders. 
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DRAWINGS 



FIG. 1 

Diagram showing principle of the present invention 
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FIG. 2 

Block diagram showing transmitting-side main components 
according to an embodiment of the present invention 
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FIG. 3 Block diagram showing receiving-side main 

components according to an embodiment of the present invention 
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FIG. 4 Block diagram showing transmitting-side main 

components according to another embodiment of the present 
invention 
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FIG. 5 Block diagram showing receiving-side main 

components according to another embodiment of the present 
invention 
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FIG. 6 

Block diagram showing main components in the conventional art 
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